DROPS

Document

DOI: 10.4230/LIPIcs.TQC.2023.13

Quantum Policy Gradient Algorithms

Authors: Sofiene Jerbi, Arjan Cornelissen, Maris Ozols, and Vedran Dunjko

Published in: LIPIcs, Volume 266, 18th Conference on the Theory of Quantum Computation, Communication and Cryptography (TQC 2023)

Abstract

Understanding the power and limitations of quantum access to data in machine learning tasks is primordial to assess the potential of quantum computing in artificial intelligence. Previous works have already shown that speed-ups in learning are possible when given quantum access to reinforcement learning environments. Yet, the applicability of quantum algorithms in this setting remains very limited, notably in environments with large state and action spaces. In this work, we design quantum algorithms to train state-of-the-art reinforcement learning policies by exploiting quantum interactions with an environment. However, these algorithms only offer full quadratic speed-ups in sample complexity over their classical analogs when the trained policies satisfy some regularity conditions. Interestingly, we find that reinforcement learning policies derived from parametrized quantum circuits are well-behaved with respect to these conditions, which showcases the benefit of a fully-quantum reinforcement learning framework.

Cite as

Sofiene Jerbi, Arjan Cornelissen, Maris Ozols, and Vedran Dunjko. Quantum Policy Gradient Algorithms. In 18th Conference on the Theory of Quantum Computation, Communication and Cryptography (TQC 2023). Leibniz International Proceedings in Informatics (LIPIcs), Volume 266, pp. 13:1-13:24, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)

Copy BibTex To Clipboard

@InProceedings{jerbi_et_al:LIPIcs.TQC.2023.13,
  author =	{Jerbi, Sofiene and Cornelissen, Arjan and Ozols, Maris and Dunjko, Vedran},
  title =	{{Quantum Policy Gradient Algorithms}},
  booktitle =	{18th Conference on the Theory of Quantum Computation, Communication and Cryptography (TQC 2023)},
  pages =	{13:1--13:24},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-283-9},
  ISSN =	{1868-8969},
  year =	{2023},
  volume =	{266},
  editor =	{Fawzi, Omar and Walter, Michael},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.TQC.2023.13},
  URN =		{urn:nbn:de:0030-drops-183230},
  doi =		{10.4230/LIPIcs.TQC.2023.13},
  annote =	{Keywords: quantum reinforcement learning, policy gradient methods, parametrized quantum circuits}
}

Search Results

Documents authored by Jerbi, Sofiene

Quantum Policy Gradient Algorithms

Abstract

Cite as

Thanks for your feedback!

Could not send message